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Abstract. Discrete amorphous materials are best described in terms of arbitrary networks 
which can be embedded in three dimensional space. Investigating the thermodynamic 
equilibrium as well as non-equilibrium behavior of such materials around second order phase 
transitions call for special techniques. 

We set up a renormalization group scheme by expanding an arbitrary scalar field living on the 
nodes of an arbitrary network, in terms of the eigenvectors of the normalized graph Laplacian. 
The renormalization transformation involves, as usual, the integration over the more "rapidly 
varying" components of the field, corresponding to eigenvectors with larger eigenvalues, and 
then rescaling. The critical exponents depend on the particular graph through the spectral 



CZ3 density of the eigenvalues. 

C3 



1. Introduction 



Networks are ubiquitous in modeling discrete random media. For example granular media 
are characterized by contact or force networks [TJ [2]. Networks of slow regions are found 
to percolate near the glass transition. [31 H] Apart from interest in the network properties 
themselves, networks provide a convenient scaffolding on which one may describe the fluctuations 
in quantities that do not live on periodic lattices or are not necessarily embedded in a metric 

l/-j space. 

This paper describes an attempt at developing a renormalization group treatment of a scalar 

^l field living on a complex network. 

Critical phenomena on complex networks have been thoroughly studied. The field has been 
expertly reviewed by Dorogovsev et al. [5]. The Bethe approach gives rise to exact results for 

^h networks which are asymptotically tree like [61 [7] . Mean field like methods have been adopted 

to heterogeneous graphs [8]. A Landau-type phenomenological approach has been developed 
for arbitrary networks [9], where the explicit dependence of the critical behavior on the full 
degree distribution P(k) is demonstrated. It is known [61 [7] that for networks with a divergent 
(A; 2 ), there is no phase transition except at infinite temperature in the "thermodynamic limit." 
The phase transition exists and is of infinite order for finite number of nodes N, and a special 
universal behavior is observed for all known models falling into this class. The critical behavior 
of the response function associated with the order parameter is mean field (exact) for scale free 
networks having degree distributions with convergent second moments (6J [10] . Exact real-space 
transformations have also been performed on scale free hierarchical networks, see, e.g. |llj . A 
Berezinskii-Kosterlitz-Thouless phase with power law correlations, and a phase transition that is 
infinite order has been observed on networks with strongly inhomogeneous degree distributions, 




e.g., graphs with degree distributions P(k) ~ /c~ 7 and 7 sufficiently small [3 Q21 [THl Q3] , leading 
to departures from mean field behavior. The presence of nodes with a diverging number of edges 
gives rise to Griffiths sigularities [T51 [TEl QZ] . 

In spite of the rich literature on critical phenomena on arbitrary networks, the possibility 
of developing a "field theoretic" renormalization group on networks has not been explored so 
far, at least within a condensed matter context. Although some basic mathematical concepts 
needed to construct such a method are available, it turns out that there are also a number of 
unexpected challenges. 

The paper is organized as follows. In Section [2] some basic mathematical tools are assembled, 
in Section [3] the field theoretic renormalization group, a la Wilson is very briefly reviewed. In 
Section[4]a renormalization group transformation is introduced for the relevant Landau-Ginzburg 
Hamiltonian density on a scale free network and the main difficulties are outlined. In section 5, 
a replica approach is used to perform quenched averages over stochastic spectral densities and a 
brief discussion of renormalization on deterministic hierarchical lattices is provided. In Section 
[6] we present some conclusions and pointers for future work. 

2. The Graph Laplacian and the Laplace Spectrum 

Let us define a graph as a collection of N vertices, or "nodes," labeled i= 1, . . . , N and connected 
to each other by edges. The adjacency matrix A completely specifies such a graph, with 

if (i,j) connected by an edge 
otherwise 

If no self-interactions are allowed An = . The "degree" ki of the ith node is the number of 
edges that connect it to other nodes, which are then called its "neighbors," and ki = Y2-j ^ij- 

For an undirected graph, A is symmetric, by definition; in this paper we will deal only with 
undirected graphs. The invariants of the adjacency matrix are of course independent of the order 
in which the nodes are labeled, and so are all the different statistics on the graph in which one 
may be interested, such as the degree distribution (the probability distribution of the number 
of edges that the nodes have). On the other hand, unless the nodes are identified in the same 
way, it is not trivial to compare two graphs. 

We will focus here on graphs that are not necessarily embedded in metric spaces, so that the 
edges do not carry information regarding the "distance" between neighboring nodes. Distance 
between an arbitrary pair of nodes (i,j) on the graph is simply defined as the least number of 
edges one has to traverse in going from node i to node j. 

The formal analogue of the Laplace operator on an arbitrary graph, is the graph Laplacian [18, 
[TTJl |2"U] which is defined as 

L = D- A (2) 

where 

and ki is the degree of the ith node. 

Note that for any scalar field f = (/1, . . . , /jv) on a network of size N, 

(Lf), = Y,Ujf 3 = hh-Y.h > ( 4 ) 

where A/i is the set of neighbors of the node i. 

By construction, ^ ■ Lij = 0. For an undirected graph the eigenvectors 

L u A = Au A (5) 



are orthogonal since A is symmetric, the eigenvalues A are real and non-negative (please do not 
mistake the symbol A for a wavelength!). If the graph consists of one connected component, 
Ao = is non-degenerate. There is a finite gap between the zeroth and the first eigenvalue 
Ai > 0, which is bound away from zero for finite graphs. It is convenient to put the eigenvalues 
in ascending order with < Ai < A2 . . . < Ajv-i, and define the largest eigenvalue as Ajv_i = A. 
The following useful properties are easy to show. The elements of the eigenvector belonging 
to a non-degenerate zero eigenvalue will be constant (which can be chosen c = N^ 1 ' 2 for 
normalization) , 

u\ Q {i) = c \/i . (6) 

If the graph consists of a number of connected components, the matrix L is of block diagonal 
form; the number of zero eigenvalues is equal to the number of connected components, and 
the corresponding eigenvectors each have elements that are constant over one of the connected 
components, and zero otherwise. The eigenvectors for A 7^ 0, on the other hand, satisfy 



5^«a(») 



. (7) 



However, it should be noted that, unlike plane waves, in general ^a u a(2) u a(J) / ^ij, arid 
similarly, ^a u a(0 ¥= 0. 

On a hypercubic lattice of dimension d, the degree of each node i is k% = 2d, and Eq. Q is 
simply the second order difference operator acting on f. For d = 1, it is easy to see that if we 
divide the right hand side with the Euclidian distance between the neighboring nodes, — L goes 
over to the Laplacian in the continuum limit, i.e., 

- V 2 f(x) = lim {2/(z) " [/(* + A) + /(* " A)]}/A 2 . (8) 

Arguments for the convergence to continuous Laplace operators can be made rigorous [1S\ [T9] . 
Moreover [19] , 



1 N 
ftLf =-£>,(/; -J,) 2 (9) 



h3 
converges to 

(f(x),£f(x))= f \Vf\ 2 dx (10) 

Jci 

where the integral is over the support of the function f . 

Note that the right hand side of Eq.Q essentially counts the number of edges over which 
(fi — fj) 2 is appreciably different from zero. One may use the Rayleigh-Ritz theorem [21] , 

f+Lf 

min — t — = minA (11) 

||f||A> ftf V > 

where A are the eigenvalues of the operator L, to partition the graph into two clusters which 
are connected by the fewest possible edges [19]. The non-trivial solution to the minimization 
problem is clearly found by setting f = u\ 1 and minA = Ai. It can be verified by explicitly (by 
computing the eigenvector u^J that its elements fall roughly into two comparable sized groups 
of positive and negative values. This clustering scheme can be generalized to larger numbers of 
clusters [15]. 

So far, it looks like the graph Laplacian provides us with an operator whose eigenvectors 
will be the analogue of the complex exponentials, so that we will be able to perform a 
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Figure 1. (Color on line.) The degree distribution (left panel) and Laplacian spectral density plotted against 
the eigenvalues A (right panel), for a "scale free" network. Shown is the preferential attachment model[22j for the 
number of initial nodes mo = 5, and m = 4 new nodes added at each time step, grown to a size of N = 5000 and 
averaged over 100 realizations. The left panel has double logarithmic axes, and the degree distribution has been 
fitted to a power law A; -7 , with the root mean square error of the fit reported in parentheses (see Table 1). For 
this figure the (linear) k axis has been binned into 5000 intervals. The Laplace spectrum (right panel) is shown 
both with linear and double logarithmic (inset) axes. The van Hove singularity in the spectral density and the 
crossover from an exponential to a power law decay is quite evident. Both histograms have been obtained with 
5000 bins on the linear scale. See text. 



transformation on our function f and analyze fluctuations at different resolutions, in analogy 
with Fourier components of different wavenumbers. (As noted above, however, the kernel of the 
transformation is not self adjoint, unlike the Fourier transform.) 

It is useful to take a look at the Laplace spectra of some sample networks. Clearly, a complex, 
scale free network would be of greater interest in this context. The degree distribution of a 
network generated using the Barabasi-Albert preferential attachment model |22| is shown in 
Fig. [Ip. Although the degree distribution fits a power law ~ A; -7 perfectly over the whole 
of its range, the Laplace spectral density (Fig. fib) is not scale free; it displays a sharp peak 
followed by a discontinuity and then, in the upper part of its range, it crosses over from an 
exponential to a power law decay, p(A) ~ A _/3 , followed by a sharp cutoff (see Fig. |2p). The 
behavior is very reminiscent of the density of vibrational states of a solid, exhibiting the van 
Hove singularity 



Table 1. Numerical values for 7 and j3 for the Barabasi-Albert [22J model. The number of initial 
nodes is mo = 5; the number of nodes added at each time step is m, and the total number of 
nodes is N = 5000. The ensemble averages of the degree and spectral distributions over 100 
realizations have been fitted, and these numbers are reported below. For the reported exponents, 
the k and A values have been log-binned into 500 and 50 bins respectively. The parentheses are 
root mean square error of the fits as illustrated in Fig. [2j 



m 



7 



P 



3 


2.7 (0.05) 1.9 (0.03) 


4 


2.7 (0.2 ) 1.9 (0.06) 


5 


2.9 (0.01) 1.9 (0.09) 



We do not have an analytic relation between /3 and 7; it is quite possible that 7 all by itself 
does not determine /3 and more work is needed to understand this dependence. 





Figure 2. (Color online.) The tail end of the Laplace spectral density, ensemble averaged (over 100 realizations) 
for the same scale free network as shown in Fig. IT] The left panel is on a linear scale; the points have been connected 
by a line. The right panel shows a fit to p(\) ~ A - ' 3 on a log-log scale, with log- binning (see Table 1). 



The ensemble averaged tail of the Laplace spectrum is shown in Fig. [2] The detail of Fig. [2] is 
astonishing. It displays a self-similar piling up of further and further decorations superposed on 
the power law decay. (For a BA model with aging of the sites [26], the Laplace spectrum displays 
even more pronounced periodic modulations.) In fact, if these decorations can be represented 
as a self-similar Weierstrass-Mandelbrot function [25J, 



A? 



W{\) ~ Wo(A) + Y^ 



g(s n X) 



s4' n 



n=0 



where g is a periodic function and s > 1 is a constant, then IF (A) has the scaling form 

W(sX) ~ s'f'W(X) . 



(12) 



(13) 



3. Order-Disorder transitions, fluctuations and the Field Theoretical 
Renormalization Group 

The Ising model, with a scalar field U{ = ±1 residing on the vertices of a lattice, is the basic 
paradigm for order-disorder transitions in statistical physics. The Ising Hamiltonian, or energy 
function for any given set {ctj}, is, for short range interactions, 



h = -jJ2 a i a j- h Yl 



CTi 



(14) 



<*j> 



where < ij > signifies that % and j are connected directly by an adge on the lattice. For J > 0, 
configurations in which the "spins" Cj predominantly have the same sign as their neighbors 
lower the energy with respect to random configurations. In thermal equilibrium at sufficiently 
low temperatures and sufficiently high connectivity of the network (for the embedding dimension 
d > 2 on periodic lattices), the spins become "ordered," i.e., the "magnetization" which is equal 
to the thermodynamic expectation value (^i "*) becomes non-zero,, even when the external 
magnetic field h is equal to zero. The magnetization can be regarded as an "order parameter." 
At the precise temperature T c where this ordering sets in, a continuous phase transition takes 
place. 



At the "critical" point T = T c , h = 0, the system is characterized by fluctuations at all 
wavelengths and a diverging correlation length. As a result, the system becomes invariant under 
scale transformations on a Euclidean lattice. Slightly away from the critical point, changing the 
resolution at which the system is observed has the effect of changing the effective temperature 
(and magnetic field). The rate at which this change occurs determines the critical exponents 
which characterize the singular behavior of the free energy, order parameter and response 
functions of the system. |27l [28] [29] (In the rest of this section we mostly follow the presentation 
of Goldenfeld [27], Chapter 12.) 

3.1. The Ginzburg-Landau Approach 

The Ginzburg-Landau approach [29j to critical fluctuations involves a passage to a continuum 
description, which is based on a local averaging of the discrete variables such as {a{\ over 
volumes still very small compared to the total size of the system, so that one may eventually 
take them to be of infinitesimal size. In this way, a continuous variable corresponding to the 
local order parameter density is obtained. Let us call this variable ?/>(x) where x indicates the 
spatial coordinates. The effective Ginzburg-Landau (G-L) Hamiltonian in the absence of an 
external magnetic field is then given by, 

H= f dx{\ [r V 2 (x) - V(x)VV] + ^ 4 (x)} • (15) 

where the coupling tq is assumed to be proportional to (T — T c )/T c = t, and vq > 0. It is 
customary to absorb a factor of 1/JzbT into H , with ks being the Boltzmann constant, so that H 
is dimensionless. This effective Hamiltonian can be expressed in terms of the Fourier coefficients 
of the order parameter, 

^(q) = ^/e^ x ^(x)dx . (16) 

The q signify wavevectors, the components of which are q a = 2im a /\Q,\ 1 ' , with each n a ranging 
over the positive and negative integers (periodic boundary conditions are assumed). For a d- 
dimensional hypercubic domain Q, in the continuum limit, the density of wave vectors within a 
volume <iq is given by |fi|/(27r) . Note that q are the eigenvalues of the gradient operator on the 
complex exponentials (which are the eigenfunctions) ; the eigenvalues of the Laplace operator on 
the same functions are simply — 1 1 q| | 2 . 

Let us write the effective Hamiltonian as H = Ho + H m t , where Hq is quadratic and diagonal 
in the ?/>(q), 



#o = x/ V^N + glf (q)^(q) ■ (17) 



1 r A q d ~ 1 dq 

2j l2nr [ 

Assuming isotropy in q-space, we have gone over to polar coordinates, obtaining the density 
(per unit volume \Q\) of wavevectors in the interval dq to be Sd ? 2 s d , where Sd is the area of the 
unit sphere in d dimensions. It is important to note that this density is in the form of a power 
law in q. The upper cutoff A is given by 2tt/1 where I is the lattice spacing. 

The interacting part of the Hamiltonian, H[ nt , involves couplings between Fourier components 
at different wavenumbers (and therefore different spatial scales) and is given by, 

/•A 4 

H^ = v dqi . . . dq 4 -0(qi) • . . ^(q 4 ) $(Y] q») • (18) 

The partition function is, 

/oo /*oo _ 

. . . / ] [ d^e~ H . (19) 



~ X °°0<|q|<A 



3.2. Renormalization Group a la Wilson 

Renormalization a la Wilson [SU] is carried out by i) integrating out the relatively small 
wavelength (large q) components of the fluctuating field in the partition function \Z7\ |2"51 I29| . 
Choosing a re-scaling parameter 6, and dividing the range of q into two parts, the partition 
function can be written (exactly) as, 

/oo /*oo 

■ • • / n *^q Wer I! d^ ppev e- H . (20) 

where we have added an extra label on the functions V>(q) to indicate the range (upper or lower)of 
wave vectors within which q lies. We would now like to do the integration over the fluctuations 
in the upper q range, ^^ per . This can of course only be done exactly for uq = 0, and therefore 
the interacting part of the G-L Hamiltonian has to be taken care of perturbatively. ii) The next 
step involves rescaling the q to restore the original range of scales over which the fields fluctuate, 
and thus the original form of the Hamiltonian density. Hi) Requiring that the coefficient of 
the diffusive (q 2 ) term in Hq remain invariant under this operation fixes the rescaling factors 
acquired by the fields ?/>(q) and the couplings r and v. It can easily be demonstrated that 
successive transformation with the parameter b satisfy all the semigroup properties (there is no 
inverse) . 

The usefulness of the field theoretic approach of Wilson lies in the precise prescription for the 
Renormalization Group (RG) transformation, and the fact that although approximations have 
to be made for an interacting theory they can be systematically improved, as a power series in 
the coupling vo, in contrast to the "Real Space" RG approach [27], where one has to perform 
uncontrolled approximate partial summations over the partition function Z. Moreover, such 
concepts as an upper critical dimension, beyond which critical behavior is exactly mean field, 
emerge only within the field theoretic RG formalism. 

4. Field Theoretic RG on a Complex Network? 

Having in mind the advantages of the Wilson approach to the renormalization group, we would 
like to construct the analogue of the field theoretic RG on complex networks. The idea is to 
expand order parameter fluctuations in eigenvectors of the graph Laplacian, write down the 
equivalent of a Ginzburg-Landau Hamiltonian, and then perform partial summations over the 
partition function, to eliminate the high-eigenvalue components. The development will closely 
follow the prescription in the previous section. 

4-1. Order parameter expansion in eigenvectors of the Laplacian for a Gaussian model 

Let us model our approach on the Ginzburg-Landau expansion of the Hamiltonian as in 

Eq. (15|17) and initially take just a Gaussian, or non-interacting model, with a field ip(i) residing 



on the vertices of a graph, with i = 1, . . . , N. In the absence of a field (which can be included 
without any problem) 

1 N 

i 

Let us define the transformed fields ift(\) by 

V(0=X^(A)ua(0 , (22) 



in terms of u^, the normalized eigenvectors of the Laplace operator associated with the 
eigenvalues A, and 

1 N 

i 

as the spectral density, i.e., the density of eigenvalues on the positive real line. Then we get, 

Ho = \ f P(A) dX $(A) [r + A] ^(A) . (24) 

z Jo 

Note that, being the eigenvalue of the Laplacian, A takes the place of the wavenumber squared, 
i.e., q 2 (it is actually dimensionless) . 

4-2. Naive renormalization of the Gaussian theory 

The partition function can now be written as an integral over the different coefficients ip\ = i/j(\) 
(we will use these notations interchangeably) . In order to perform the partial integration of the 
partition function as in Eq. (20), we choose a scale factor s. We must now integrate out the 
coefficients tp\ for A > A/s, where A is the largest eigenvalue of L on the given network. 
Denoting the Gaussian partition function with Zq, we have, 

/oo /*oo 

. . . / [] dtir* II ^A PPCr e-"° , (25) 

-oo ^-°°o<A<A/s A/s<A<A 

where Hq is now given by Eq. (24). Performing the set of integrals over the -?/\ pper yields, 



e 9(ro) 



/OO /"OO 

. . . / n * wer e-^° wer , (26) 



0<A<A/s 



where for future use we can define Zq PPBT = e 9 ^ r °' , where g(ro) is the free energy contributed 
by the high-A degrees of freedom. Since Zq only involves doing Gaussian integrals, we easily 
calculate 

^°-= n ^- < 27 ' 

A/s<A<A V U 

The Hamiltonian involving the remaining degrees of freedom is, 

flower = 1 f p{x) dx ^ower ^ + A] flower (2g) 

1 JO 

The RG transformation will be complete when we rescale the A with s so that the integral is 
once again over the range (0, A), and we can drop the label "lower" from the Hamiltonian, while 
having to "renormalize" the coupling tq. 

Let us make the naive assumption that the spectral density is a homogenous function over 
its whole range, p(\) ~ A~^, where /3 depends on the degree distribution, in particular on the 
exponent 7. 

Now make a change of variables A' = sX (so that A = A'/s). Define the rescaling factor for 
the fields via ^ lower (A'/s) = zijj'(X'). The resulting Hamiltonian is now going to be in the same 
form as Eq. (24), except that rQ will acquire a multiplicative factor. Calling the renormalized 
Hamiltonian Hq, Eq. (28) becomes, 



V)'(A') (29) 



K = IJ q P {\')dx's^zH'{x') 



X' 

ro~\ 

s 



We assume we can fix the renormalization factor z of the fields ip 1 for all A', by requiring 
the coefficient of the A' term in the Hamiltonian to remain unchanged. This gives z = s^ 2 ~^'' 2 . 



Substituting this back into Eq. (29) the various rescaling factors simplify and we find that we 
can define the renormalized coupling 

r = sro (30) 

Notice that as long as the spectral density is homogeneous, this result is inevitable for the 
Gaussian theory, independent of the scaling exponent /3 for the spectral density. {(3 should not 
be confused with the critical exponent of the order parameter!) Recall that the spectral density 
for the wavenumbers q in the Euclidean case reviewed in Section |3j was oc g ' -1 . It is useful, for 
later comparison, to define —j3 = D — 1. The fact that the spectral density decays, instead of 
growing with A is going to have strong consequences later on. 

In the Ginzburg-Landau approach we have assumed that r$ oc t, therefore the rescaling factor 
in front of r$ is related to the temperature renormalization, i.e., we here have t — )■ t' = s y t, with 
y = l- 

Recall that the eigenvalues of the Laplacian are "like" q 2 , so that the scaling factor of the 
"length like" quantities in the problem is only y/s. If we are very cavalier, we can identify 
the analogue of the correlation length exponent v = (2y) -1 = 1/2, as we would expect from a 
Gaussian theory. 

Since we have not embedded our network in a metric space, ascribing to A the dimensionality 
of a (length) -2 , and similarly making the identification of (2y) _1 with the correlation length 
exponent is rather tenuous, just as it is somewhat problematic to define a correlation length on 
this non-metric space. (Note that the dimension d is also not defined for this system. However, 
for the product du, the identification 2 — a = dv can still be made, where a is the specific heat 
exponent.) 

4-3. The ip A theory 

Consider adding an interaction term Hi nt = vo^2 i ip 4 (i), to the non-interacting or Gaussian 

theory. In terms of the transformed fields this gives, 

/•A 4 
H int = v n[p(A /i )dA / ,MAi)...TKA 4 )$(Ai,A 2 ,A 3 A4) • (31) 

where $(Ai,. . . , A 4 ) = E£=iIIJ=i«a m («)■ 

We now encounter a property of the eigenvectors of the ordinary Laplacian on a Euclidean 
lattice (e.g., plane waves) which is not shared by the graph Laplacian: An element by element 
product of the eigenvectors (eigenfunctions) of the ordinary Laplacian yields yet another 
eigenvector since the exponentials add, modulo 2ir. For the graph Laplacian, 

u\ k {i)ux l {i)...u Xm {i)^u Xn {i) . (32) 

in general, i.e., no A n can be found such that the equality holds. If the equality were to hold, 
we would have had $ = unless \ n = 0, by Eq. nh. Recall that in the ordinary Euclidean 
case, the ip 4 term in the Fourier transform representation gives rise to a Dirac delta function 
connecting the wavevectors, <5(qi + q2 + q3 + q + 4), i.e., a sum rule on the total incoming and 



outgoing "momenta," Eq. (18), while here, due to Eq. (32), no such rule applies. This gives rise 
to a markedly different scaling behavior as we will see later on. 

The interaction term has to be handled perturbatively, and following the same 



prescription [301 EZ] here we get, 

/oo /*oo 

. . . / n d ^ H 
-oo ^-°°o<A<A 

/OO /'OO 

.../ rj ^ Ae -^r° r ( e ^[^ < ^>])upper _ (33) 

-oo J —oo „ - - - . / 



_ °° 0<A<A/s 



where the interaction term now contains coefficients with A in both the lower and the upper 
range, 

V[i><, $>] = -H int ^(A) lower , 4,(X) uppei ] (34) 

where we have implicitly defined V'(^) > — ^>(A) upper , etc, and the brackets mean, 

(e V[^>] )r er = ir_r Yl d^e- H o^ e Vl^>} . (35) 

J -°° J -°°A/s<X<A 

At this point, it is standard to take a cumulant expansion, (e~ x ) ~ e~( x >e*" x ' ' x ' '. So now 
we have to compute {V[tp < ,ip > ])Q Pper and (V 2 [ip < ,ip > ])Q Pper . The angular brackets involve the 



same Gaussian measure as in Eq. (35) and the only terms that survive are those that are even 
in the ?/>(A) > , with 

<V>(A) > ^(A / ) > )S PpCr = hvTlT- = 5 AA'G(r , A) . (36) 

A + r 

defining a "contraction" between two fields ip(\) > an d i^(X') > . Unless we refer specifically to 
the ro dependence, we will drop this argument and just write G(X) for the Green's function. 

4-4- First order in perturbation theory 

To keep track of these com putations one makes use of Feynman diagrams, and the diagrams we 



need are given in Fig. Bl in Appendix B. As usual, the contribution from (V['ip < , ij) > ]) to the 



quadratic interaction comes from the singly contracted term, Fig. Bli, with the combinatoric 
multiplicative factor 6. [27]. This term is given by 

Q m=Q Vo f S dX 1 dX 2 p(X 1 )p(\ 2 ) 1 p < (X 1 )i} J < (X 2 )y^I 1 (i) UXl (i) UX2 (i) , (37) 

Jo , 

where 

h(i) = / dXp(X)G(X)ul(i) . (38) 

JA/s 

Ii(i) does not depend any more on any of the eigenvalues, and therefore is a constant under 
re-scaling, however it depends on ro, s, and A. (see Appendix B) 

If, for the moment, we neglect the dependence of the integrand on the eigenvectors u\^, 

\i = 1, 2, the scaling behavior of Q 2 is obtained by counting powers of s which arise when we 
make the transformation to A' = sX. This is the same as counting the number of integrals over 
A (each contributes a power 1 — /?) and counting the powers of ip, which contribute a factor of 



z , i.e., a power of (2 — j3)/2 each. In total we have the rescaling factor —2 + 2/3 + 2 — j3 = (3. 



\c$ = l2sPvof d\ l d\ 2P {\ 1 )p{X 2 )i,{\ 1 )i,{\ 2 )Y J hii)ux 1 {i)u X2 (i) , (39) 



Taking into account the forefactor of 1/2 appearing in Hq, Eq. (28) we get, 

3^ = 12^0 / 
2 J ° 

for the contribution from the interaction term to the quadratic coupling, to first order in vq. 
This contribution is not diagonal in the eigenvalues A, unlike the original Gaussian coupling in 
Hq, and moreover it depends on A, so in principle the original Hq also has to be modified. Note 
that, had the new quadratic term been diagonal, the renormalization factor would have been 
s~ 1+ ° z 2 = s, rather than s" . 

Grouping together all the quadratic terms, absorbing any possible corrections to the scaling 



coming from ^2i h(i) u\ 1 (i)u\ 2 (i) into what we shall define as I\ and using Eq. (30), we get, 

r = sr + Uvos^h , (40) 

with the fixed point equation, 

I2v s^h 

r = — . (41) 

1 — s 

The uncontracted term in (V) with all the fields in the lower-A range (Fig. |Blb ) gives, again 
by the same kind of power counting as above, a renormalized coupling constant 

v = VoS 2 l 3 $ , (42) 

where possible corrections to scaling are included in <£. This equation has zero as fixed point, 



v* = 0, leading to r* = via Eq. (41). Thus, to first order in vq, the Gaussian fixed point is 
stable, analogously to the Euclidean case. 

We can now make a generalization, using our definition D — 1 = —j3. Consider a Feynman 
diagram with n legs. This will mean n integrals over A, in the absence of "momentum 
conservation," and therefore a factor of s~ . Each leg carries a factor of tp < , and therefore 
we get a factor of z n = s^ D+1 ^ n ' 2 , resulting in a re-scaling factor of s^ D " in ' 2 = s n/3 ' 2 . But 
/3 > and the power of s is now always positive. We see that there is no analogue of the upper 
critical dimensionality, above which the ip 4 interaction terms become irrelevant in the ordinary 
■0 4 Euclidean theory for scalar fields. (One recovers the Ginzburg-Landau- Wilson result for 
n = 4 by substituting d for D, taking only n — 1 factors of s~ D and z = s^ d+2 '' 2 due to the q 2 
diffusive term, rather than a linear term in A.) 

All the contributions to the renormalized Hamiltonian, to all orders in perturbation 
theory, will grow indefinitely under successive renormalizations, i.e., are "relevant" in the RG 
terminology. To first order, we are only saved by the fact that there exists a unique fixed point 
at v* =0. We seem to be faced with an uncontrollable phenomenon of "proliferation" ! 

4-5. Second order in perturbation theory 

Now we would like to see explicitly what happens when we take into account terms that are 

higher order in vq. 

The bubble diagram (Fig. |Blb ) is already familiar from the Euclidean case, and contributes 
to the renormalized 4- vertex. Using the results of Appendix B, we have 



v s 2 ? 



$ - 36v (h) 2 . (43) 



There are further terms which contribute to the quadratic coupling, which would not survive 
in the ordinary case because of the "momentum conservation" rule ( two "lower" momenta 



cannot be summed with two "upper" ones to give zero) . These calculations are given in Appendix 
B, and here we will only report the results. 

Performing the rescalings over the second order contributions and putting together all the 
results, we have, 

r = sr + I2v s^h - v% [(72 + 48)(/i) 3 ] s? . (44) 

The solution for the fixed point equations, besides the trivial one where r* = 0, v* = 0, are 

* = -^- ■ <«> 

and 



tr 12-^[l20(Ji) 

1 i --, : 

Taking 1% to lowest order in rg gives, 



r* = aVli— — - i""^ 1 ' J , (46) 

1 — s 



which leads to 



h ~ ^ { -^J^ (47) 



v oc V (g/3 _ 1} j • (48) 



We see that, up to the approximations we have made, the s dependence does not drop out of 
the Eqs. (45|46). Apart from the fixed point at v* = 0, there is no finite fixed point for v. 



There is one other connected graph to second order in vq, which is obtained by taking one 



field from each subgraph and contracting them (see Fig. Bl r ) obtaining a ip interaction. We 
have computed its scaling factor explicitly, and find, in accordance with the power counting 
scheme of the previous section, that it scales like s 3/3 , i.e., it is yet another relevant coupling. 



The Laplace spectrum for a scale free network, shown in Figs. TJ2 is not a homogeneous 



function over the entirety of its range. We could think of taking the re-scaling parameter to be 
very close to unity, s = 1 + 5 with <5< 1 but this does not help us find a non-trivial fixed point, 



and taking 6 — >■ leads to a blow-up of Eq. (48), just as taking A — > oo does. Substituting (48) 



into (46) leads to the same problems. We must conclude that the only physical fixed point in 



this perturbative treatment is at r* = 0, v* = 0. 

5. Stochastic and deterministic complex networks 

5.1. Replica approach to a quenched average over the spectral density 

In the previous subsections we have pushed forward the computations with the naive assertion 
that the spectral density scales simply as p(s\) ~ s^^p(X). However, it is clear from the Figs. 
[T] and [2] that the truth is somewhat more complicated than that. In particular, we proposed 
that the average over 100 realizations of the network can be represented by the Weierstrass- 



Mandelbrot function (12). Therefore, in order to really speak about a non-stochastic spectral 
density, we should take an average over different realizations. In the present case, this has to be 
a quenched average taken over the free energy of the system, since by assumption the network 
is fixed and does not fluctuate within the relaxation times of the fields (spins) living on the 
network. 

It is standard to use the "replica method" [HI [321 E3] to be able to take the average over 
the logarithm of the partition function. The trick is to introduce n independent replicas of the 
system and to take the average over Z n , finally using the identity lim n _>.o(-^ n — l)/ ra = InZ. 



To illustrate how the calculations have to be done let us take the non-interacting, Gaussian 
theory as a starting point. Then, 

/oo n 
JJIJctytoe-E-^o , (49) 

-OO 1 



-°°Q=1 Z 

where a = 1, ... n is the replica index, 






z-Xi) . (50) 



and we have used Eq. ( 23 ) . 

If the distribution over different realizations of the spectrum Ao, . • • , Aat_i is denoted by 
V({\i}), we have 

/OO n f 

[] n# / dX ...dX N ^ 1 V({X l })e-^ H o . (51) 

-°°a=l z J 

This expectation value now looks like a path integral over individual paths {X{\. Let us define 

(^^2(ro + z)8(z-X t )}^p(z) . (52) 

i,a 

A cumulant expansion up to second order gives, 
where 



Ci = \{f dzl^(r + z)5(z-A,)(C) 2 ) = 

^fdz(r + z)p(z)$2)* . (54) 

The second cumulant gives rise to bi-quadratic terms which couple different replicas, 
C2 = 4j TidXiPHXi}) J dxdy w 

x E E t( r o + x )( r ° + y) 5 ( x - A *) 6 (y - x ^ (C) 2 (^) 2 - °l 

= \ I dz(r + zf p{z) Yffi?lM?} > ( 55 ) 

where the off-diagonal terms in i,j have been cancelled by C\. Thus it turns out that 
averaging the spectral density over different realizations, one ends up with a bi-quadratic term 
in the Hamiltonian, which could have been included from the start. We get, for the effective 
Hamiltonian, 

rA 



H cS = l[ dXp(X)(r + X) Y$. 



w ]a 



\f dXpiXXro + Xf^xW^f • (56) 



a,P 



Note, however that there is no small parameter which allows us to terminate the cumulant 
expansion or in which to expand the biquadratic term. (For treatment of this problem via 
functional RG methods see [53] . 

The first term in the Hamiltonian, up to the summation over the replica indices, is essentially 



what we started off with in Section 4.2 and in the n — > limit will give the same free energy. The 
renormalization of the quadratic term will therefore be the same, with r = sr$. The bi-quadratic 
terms with the new interaction U4 = r 2 . + 2r$\ + A 2 now have to be treated in a perturbative 
fashion relative to the Gaussian term, using another cumulant expansion. The different terms 
in the uncontracted vertex acquire the re-scaling factors s 3- ^, s 2 ~@ and s 1 ~^, in this order. 
Although this has to be checked in detail, we conjecture that they are thus irrelevant for /3 > 3, 
and therefore to first order the theory remains Gaussian. The new quadratic couplings coming 
from the once-contracted graphs, however, depend on A and are not trivial. 

Inclusion of a VQip 4 " interaction, under the quenched averaging, gives rise to a bi-quadratic 
and a quartic term where the number of A integrals are reduced to 2 and 1 respectively, with 
further simplifications now due to Gaussian contractions in the cumulant expansion in vq. Power 
counting suggests that these terms are irrelevant for /3 > 3/2 and (3 > 5/3 to first order in vq. 

5.2. Deterministic hierarchical lattices and the matrix extension method 

For some hierarchical networks obtained by successive decorations of a seed graph, the spectrum 
of the normalized Laplacian can be computed iteratively. [33] Under graph decoration, the "matrix 
extension transformation" yields all the new eigenvalues, in terms of the existing ones |36l I37| . 
It has been shown that most of the spectrum is given by the pre-images of the so called "spectral 
decimation" transformation A = -R(A'), and converges to the Julia set of i? _1 as N — > 00 |35j . 
Moreover, one can easily check that the attractor (the Julia set) is chaotic, with the preimages 
of many eigenvalues jumping back and forth between different intervals < A < 1 and A > 1. 
We conjecture that similar properties may also hold for the un-normalized Laplace spectrum 
which we have been treating in this paper. Thus there is no smooth way in which to rescale 
existing eigenvalues to restore the integrated-out ones; although the network is deterministic, 
the rescaling transformation on the spectrum itself could just as well be stochastic. 

It is interesting to recall a chaotic "real space" renormalization group transformation [38| 
encountered in a frustrated Potts model on a hierarchical lattice. This example shows that a 
finite interval below the critical temperature may become densely populated with critical points 
(singularities of the free energy) leading to BKT like behavior, similar to that found by Andrade 
and Herrmann [llj . 

6. Conclusions 

In this paper we have tried to explore the possibilities offered by the eigenvectors and eigenvalues 
of the graph Laplacian to develop a field theoretic renormalization group (FTRG) approach to 
order-disorder phenomena on complex networks. We have taken a tutorial approach which 
intends to acquaint the reader with the ideas of FTRG, and then to build upon these ideas in 
order to develop the analogous machinery on a complex network. We have been able to carry 
over most of the basic concepts and to implement many of the usual procedures. 

The proliferation of higher order terms in the renormalized Hamiltonian was brought under 
control by going over to a quenched average over different realizations of the stochastic network 
using a replica approach. We found that for j3 > 3, the first order perturbation expansion in the 
bi-quadratic couplings introduced by the quenched average were irrelevant, and that the theory 
remained Gaussian. Inclusion of a quartic interaction can also be shown to be irrelevant for 
/3 > 3/2 up to first order in v$. Further work is in progress. 

The A-dependence acquired by the effective renormalized couplings persist, and in principle 
would call for a nonlinear transformation A' = T S {X) parameterized by the scale factor s. 



This, in turn, calls for an initial A-dependent temperature like coupling constant, r(A). The 
A-dependent transition temperature, also indicated by the calculation in section |5.1[ may be a 
way to understand the Berezinskii-Kosterlitz-Thouless (BKT) power law behavior of correlations 
obtained over a range of temperatures for T <T C found in Real Space RG calculations on scale 
free networks. |llj 
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Appendix A. Normalized Laplacian 

It is possible to define the "normalized" graph Laplacian via 

L = D -1 L = I - D -1 A , (A.l) 

where I is the identity matrix. 

Eigenvectors of the normalized Laplacian are no longer orthogonal to each other, but one 
has, 

vJ,D v = a^/ . (A.2) 

An advantage to using the normalized Laplacian in this context is that the eigenvalues are 
confined to a fixed interval [0, 2] such that po = 0, < m < ^2 ■ ■ ■ ftN-i < 2. In this way the 
eigenvalue spectrum gets denser and smoother as the graph becomes larger. 

For many properties of normalized and unnormalized Laplacian spectra, see Ph. D. thesis of 
A. Banerjee. [20j 



Appendix B. Second order contributions to the renormalized Hamiltonian 

For compactness of notation we have defined d^ = dX^p(X^), where A M appears in a subscript it 
will be just represented by /i, and J* A , = J . 



The second order contribution from the perturbation expansion (Fig. Br:) to the ift' 



vi 



interaction in the renormalized Hamiltonian is given by the doubly contracted term, 

J J . 1 A 



M =l,...,4 



and 



Qf = ]T{ui(i)u 2 (^3(jM.?)/ / l[[dvG(\ v )}u a (i)u a (j)u b (i)u b (j)} (B.2) 

i,j u=a,b 

where we have re- numbered lines so that the indices /i = 1,2,3,4 belong to the external legs 
and v = a,b belong to the internal lines; i,j index the elements of the eigenvectors. Defining, 



after Eq. (38) 



h{%,3) = J d\p(X)G(X)u x (i)u x (j) , (B.3) 

we may re- write, 

Qi 2) =Ei ni « U2 « u 3(j>4(j)^2(i,i)] 2 } • (B.4) 



The effective coupling 36v 2 Q A depends on the eigenvectors Ai, . . . A4. The re-scaling factor for 
this 4- vertex can be obtained by power counting to be s 2 ^, up to the corrections which might 
come from this dependence. In the best RG tradition [27] we will neglect the A dependence of 
the 4-vertex in what follows. If we also neglect the (i,j) dependence of I 2 and I\ (which then 
become identical) we simply have 



QT oc (hf 



Expanding I\ in ro gives, from Eq. (38), 



A-? 



(/ - 1) 






0+1 



i) 



(B.5) 



(B.6) 



OCX f ■> — (- 



Figure Bl. The Feynman diagrams to which reference is made in the text. In the context of the ip 4 theory, the 
diagrams a), e) and d) contribute to the renormalized quadratic couplings; b) and c) to the quartic coupling, and 
f) to a sixth order coupling. As usual, a vertex (where four lines meet) is proportional to the coupling constant 
vn, the "internal" lines (which are connected to a vertex at both ends) denote the Green's function G(ro, A), Eq. 



(36 1, and each "external" leg carries a factor ip{ 



One contribution (Fig. Bli) the quadratic coupling to the second order is, with 1,2 denoting 
the external legs, 



•> r> r> 



Q^l = 72^0^ mi (i)u 2 (i) / / / II d v G ( X rnu)u 3 (i)u 3 (j)u 4: (i)u4(j)u 5 (j)'' 

i,j J J J ^=3,4,5 



72v 2 ^2u 1 ( i ) U2 (i)[I 2 (iJ)] 2 h( i ) 



(B.7) 



'../ 



Note that, to the same approximation as above, we have 

Q?} oc (/i) 3 . 
The other contribution is given by is (Fig. |Blb ) 

Q2I = ^8v 2 ^2 Ul (i)u 2 (j) [I 2 (i,j)f oc (hY 



(B.8) 



(B.9) 



1 -j 
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